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An  Algebraic  Approach  to 

A  Calculus  of  Functional  Differences: 

Fixed  Differences  and  Integrals 


B.  J.  MacLennan 

Computer  Science  Department 

Naval  Postgraduate  School 

Monterey,  CA  93943 


Abstract 


We  introduce  a  notion  of  functional  differences  in  which  the  difference  of  a  function  /  with  respect 
to  a  function  h  is  that  function  g  that  describes  how  the  value  of  /  changes  when  its  argument  is 
altered  by  h:  fh{x)\  =  g[f(x)\.  We  also  introduce  the  inverse  operation  of  functional  integra- 
tion and  derive  useful  properties  of  both  operations.  The  result  is  a  calculus  that  facilitates 
derivation  and  reasoning  about  recursive  programs.  This  is  illustrated  in  a  number  of  simple 
examples.  The  present  report  uses  algebraic  methods  to  establish  preliminary  results  pertaining 
to  fixed  differences,  that  is,  functional  differences  that  do  not  depend  on  the  value  of  the  argu- 
ment x. 


1.    Motivation 

Simple  recursive  definitions  often  take  the  following  form: 

fao  =   y0 

f(hx)    =    g{fx),  for  z*z0  (1) 

The  assumption  here  is  that  an  arbitrary  domain  value  x  can  be  reached  by  finitely  many  appli- 
cations of  h.  That  is,  for  all  acceptable  x  there  is  an  n  such  that  x  =  hn  x0.  More  general  pat- 
terns of  recursive  definition  will  be  considered  in  Section  6  and  more  generally  in  [MacLennan 
'88]. 

Many  of  the  results  in  this  report  are  included  in  [MacLennan  '86j,  however,  that  report  used 
methods  from  the  calculus  of  relations  [Carnap  '58].  The  present  report  obtains  the  same  results 
more  easily  by  use  of  the  methods  of  abstract  algebra.  The  reason  that  the  algebraic  approach  is 
easier  seems  to  be  that  the  algebraic  notion  of  a  function,  which  incorporates  the  domain  and 
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codomain  as  part  of  its  definition,  automatically  takes  care  of  issues  that  must  otherwise  be  han- 
dled explicitly.  In  particular,  the  algebraic  notation  (and  its  assumption  that  all  functions  are 
total)  simplifies  reasoning  about  the  domains  of  functions.  Comparing  the  derivations  in 
[MacLennan  '86]  and  the  present  report  is  illuminating  in  this  regard.  The  algebraic  approach  is 
essential  for  the  investigation  of  variable  differences  and  their  associated  integrals  that  will  be 
presented  in  a  later  report  [MacLennan  '88];  for  now  we  restrict  our  attention  to  fixed 
differences.1 

In  deriving  a  recursive  definition  for  a  particular  /,  there  are  four  unknowns  that  must  be 
found,  g,  k,  x0  and  y0.  Since  h  and  x0  are  usually  determined  by  the  domain  in  question  (e.g., 
they  are  zero  and  the  successor  function  for  the  domain  of  natural  numbers),  and  j/0  is  usually 
easily  determined  from  the  definition  of  /,  the  main  problem  is  determining  the  function  g. 

To  see  how  this  can  be  done  consider  the  second  line  in  Eq.  1: 

f(hx)    =    g(fx) 

The  function  g  tells  us  how  much  the  value  of  the  function  /  changes  when  its  argument  is 
changed  by  h.  That  is,  if  /'s  argument  is  changed  by  k,  then  its  value  is  changed  by  g.  This 
equation  is  analogous  to  the  finite  difference  equation 

f(h+x)    =    g+(fx) 

The  difference  is  that  in  the  first  equation  the  "amounts  of  change"  are  expressed  as  functions 
rather  than  numbers,  as  they  are  in  the  finite  difference  equation.  This  is  because  we  want  to  be 
able  to  deal  with  functions  whose  domains  and  ranges  are  nonnumeric  (e.g.,  lists,  sets,  relations).2 
Based  on  this  analogy  we  introduce 

Definition  1:    Suppose  /:  S  -»  T,  g:  T  -*  T  and  h:  S  -»  S.    We  define  g  to  be  a  (fixed)  func- 


1.  Note  that  for  fized  differences  there  is  no  distinction  between  forward  differences  and  backward  differences.    This 
distinction  will  become  important  in  the  study  of  variable  differences. 

2.  A  different  notion  of  functional  differences  is  described   in   | Paige  &   Koenig  '82j.     Their's  is  addressed  to  the 
problem  of  updating  data  structures  such  as  sets  in  an  imperative  context. 
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tional  difference  of  /  with  respect  to  h  if  and  only  if  it  satisfies  /  »  h  =  g  °  f.  Furthermore,  if 
the  functional  difference  is  unique,  we  write  g  =  h  A  /,  and  call  g  the  "h  difference  of  /."  We 
also  call  g  ''the  change  in  /  with  respect  to  /i"  or  "the  change  in  /  given  the  change  k."  Thus, 
when  the  difference  exists  and  is  unique  we  have 

/  .  h    =    (fc  A  /)  •  / 

(2) 

2.    Existence  and  Uniqueness  of  Fixed  Differences 

Equation  2  defines  the  functional  difference  implicitly;  to  get  an  explicit  definition  we  need  to 
solve  it  for  h  A  /.  This  can  be  accomplished  by  composing  with  the  inverse  of  /,  /-1,  on  both 
sides  of  the  equation  to  yield: 

h  a  f  =  /  •  h .  r1 

This  seems  to  yield  an  explicit  formula  for  the  functional  difference,  but  it  is  necessary  to  be  more 
careful,  since  it  assumes  the  existence  of  the  (right)  inverse  f~1.  Recall  that  a  right  inverse  f~l, 
with  /  °   f~l  =  I r,  exists  only  if  /  is  surjective.    (We  write  1T  for  the  identity  I:»T  -»  T.) 

Theorem  1:    Let  /:  S  ->  T  be  a  surjection,  let  h:  S  ->•  5,  and  let  g:  T  ■—  T  be  any  function 
satisfying  the  equation  /  •  h    =    g  »   /.    Then  g    =    f  °   h  °   /r_1,  where  /r_1  is  a  right  inverse  of/. 

Proof:   We  compose  on  the  right  with  f~x  on  both  sides  of  the  equation  and  simplify: 

g-   f    =    /•    h 

g    .     f    .     f-l      =      f.     h.     f-l 

?  =  /  •  h  °  f;1 


The  preceding  theorem  assumes  a  difference  exists.    The  following  theorem  establishes  conditions 
sufficient  for  its  existence. 


Theorem  2:  Let  /:  S  -»  T  be  an  injection  and  let  h:  S  -»  5.  The  functional  equation 
/       h  g  "   f  has  solutions  /  «    h       f,  '.  for  each  left  inverse  /,  *  of  /. 

I'roof:  For  convenience  we  represent  composition  by  juxtaposition  when  no  ambiguity  will 
result.  Since  /  is  injective  it  has  a  left  inverse  /f1,  with  f[xf  =  Is.  Hence,  letting  g  =  /A/,-1,  we 
have 

0/  =  wr1)/  =  /M/r1/)  =  fhis  =  ^ 

Hence,  the  difference  equation  is  satisfied,    o 

We  observe  in  passing  that  none  of  the  preceding  results  depend  on  h  being  either  injective  or 
surjective.    Thus,  they  apply  to  any  function  h:  S  -»  S.3 

Theorem  2  establishes  sufficient  conditions  for  the  existence  of  solutions  to  the  difference 
equation,  namely  that  /  is  an  injection.  The  following  theorems  establish  necessary  and  sufficient 
conditions  for  the  existence  and  uniqueness  of  solutions.  However,  to  state  them  we  need  the  con- 
cept of  an  equivalence  kernel  [MacLane  &;  Birkhoff  '67]. 

Definition  2:  The  equivalence  kernel  E,  of  a  function  /:  S  -»  T  is  the  following  relation  on 
S  x  5: 

E}    =    {  (z,  x)  E  5  x  S\   fx  =  fx'  } 

(3) 

Thus  (x,  x' )  f  E,  if  and  only  if  fx  =  fx' .    Now  we  can  state  our  existence  theorem: 

Theorem  3:    A  solution  g  to  the  difference  equation  fh  =  gf  exists  if  and  only  if  E,  C  E*. 

Proof:  To  prove  the  "if"  part,  assume  that  E,  C  £"«.  Every  function  f:  S  ->  T  can  be  writ- 
ten as  a  composition  /  =  4>F  in  which  4>:  S! Ej  —  T  is  an  injection  and  F:  S  -»  5/E/  is  a  surjec- 
tion.    Also,  since  £/  C  £"«,  /A  can  be  written  as  a  composition 


3.  In  iMacLennan  '86]  we  introduced  at  this  point  the  idea  of  an  "isomorphic  image"  from  the  calculus  of  relations. 
This  was  used  to  prove  a  number  of  existence  theorems  for  functional  differences.  Algebraic  methods  obviate  the 
need  for  this  approach.    However,  Hasse  diagrams  are  still  useful  for  visualizing  functional  differences. 
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fh    =     ttPF 

(4) 

where  n:  S/E^  -*  T  is  an  injection  and   P:  S/E,  -»  S/  E^  is  a  surjection.    Now  we  claim  that 
9  =  4>K<t>1x  is  a  solution  to  the  difference  equation.    This  is  checked  by  substitution: 

gf    =    (4>n^)(</>F)    =    <f>7rF    =    fh 

a  solution  exists  if  E,  C  E^. 

Now  to  show  the  "'only  if  part  assume  that  there  is  a  g  such  that  fh  =  gf.  Observe  that 
Ei  C  E  ,  is  always  true,  since  g  cannot  separate  values  that  have  already  been  mapped  together 
by  /.    But  since  fh  =  gf,  E^  =  E  ,,  and  therefore  Ei  C  E^ .    Q 

Theorem  4:  Suppose  S  ^=  1  and  the  equation  fh  =  gf  has  a  solution  g.  Then  this  solution  is 
unique  if  and  only  if  /  is  surjective. 

Proof:  We  prove  the  contrapositive  of  the  "only  if"  part.  Therefore  suppose  that  /:  S  -»  T  is 
not  surjective.    Therefore  there  is  a  y  6  T  such  that 

y    $   R    =    Im  /    =    {  y  |    y  =  fz  for  some  x  €  5  } 

(5) 

We  construct  a  g'  different  from  g  that  also  solves  the  equation.    Let  g'y  =  a  ^  yj/,  which  is  pos- 
sible so  long  as  S  ^  1.    Note  that  since  y  $  R,  g' f  =  gf,  and  hence  9'/  =  fh. 

For  the  "if  part,  suppose  that  both  g  and  g'  are  solutions  and  that  /  is  a  surjection.    Hence, 

g'f  =  fh  -  gf 

(6) 

Since  /  is  surjective  it  has  a  right  inverse;  compose  with  both  sides  of  Eq.  6  to  yield: 

9    =  g'ff7l  =  gffr'1  =  g 

Hence,  g  =  g'  and  the  so  the  solution  is  unique.    □ 


-5- 


Obviously  it  is  a  critical  issue  whether  /  is  surjective  or  not.  Therefore  we  investigate  the 
relationships  between  the  differences  of  surjective  and  nonsurjective  functions. 

Definition  3:  The  difference  equation  fh  =  gf  is  called  homogeneous  if  /  is  surjective,  and 
nonhomogeneous  if  /  is  not  surjective. 

Corollary  4-1:  Homogeneous  difference  equations  have  at  most  one  solution;  nonhomogene- 
ous difference  equations  do  not  have  unique  solutions  (i.e.,  they  have  no  solutions  or  more  than 
one  solution). 

Proof:   Follows  from  Theorem  4  and  the  definition  of  homogeneous.    □ 

Next  we  characterize  the  many  solutions  of  a  nonhomogeneous  equation  as  a  family  of  functions 
derived  from  an  associated  homogeneous  equation. 

Definition  4:    If  S  C  T,  we  use  js_  T  for  the  trivial  injection  of  S  into  T:    js^Tx  =  x. 

Definition  5:  Suppose  that  /:  S  -*  71,  g:  T  ->  T,  h:  S  ->  5,  and  R  =  Im  /.  Note  that  /  can 
be  written  uniquely  in  the  form  /  =  Jn^jf  where  f':S->R.  Then  we  call  fh  =  gf  the  homo- 
geneous equation  associated  with  the  nonhomogeneous  equation  fh  =  gf. 

Definition  6:  If  /:  S1  -»  T  and  g:  S2  ->  T,  then  we  define  the  direct  sum, 
(f  -  g):  (S,  +  S2)  -  7\  by 

ifx  i*«eS, 

('^)*    =    \gXlfXeS2  (7) 

Theorem  5:    Let  /:  5  -  7\  g:  T  -  T,  h:  S  -  S,  R  =  Im  /,  Q  -  T  -  R  and  j  =  jR^T.    Then  g 
is  a  solution  to  the  nonhomogeneous  equation  fh  =  gf  if  and  only  if  it  can  be  written  in  the  form 

9    =   j{g0  +  c) 

(8) 

where  gQ:  R  —  R  is  the  solution  of  the  associated  homogeneous  equation,  and  c:  Q  ->  R. 


Proof:   For  the  "only  if  part  assume  that  fh  =  gf  has  a  solution.    Therefore, 

Im  g    C    Im  gf    =    Im  fh    C    Im  /    =    /? 

Hence,  Im  y  C  fi.  This  means  that  y  can  be  written  as  the  direct  sum  in  Eq.  10.  It  remains  to 
show  that  g0  is  a  solution  to  the  homogeneous  equation  f'h=  g0f .  Since  fh  =  gf,  f  =  jf  and 
9  =  j(9o  +  c),  we  know: 

jf'h    =    ]{9o  +  c)Jf 

Since  j  is  an  injection,  we  can  compose  its  inverse  on  the  left  of  both  sides  of  this  equation  to 
yield: 

/'*    =    (<7o  +  c)jf 

Now  notice  that  [g0  +  c)j  =  g0;  therefore  f  h  =  g0f  and  we  have  proved  that  gQ  is  a  solution. 
In  fact  it  is  the  unique  solution  because  the  equation  is  homogeneous. 

To  prove  the  "if1  part  we  assume  that  there  is  a  g0  such  that  fh  =  gQf .    Let  g  =  j(g0  +  c); 
our  goal  is  to  show  fh  =  gf.    Noting  again  that  (g0  +  c)j  =  g0,  derive: 

fh    =  jf'h 

=  39of 

=  J{9o  +  c)if 

=  gf 

Hence  g  solves  the  nonhomogeneous  equation.    D 

Corollary  5-1:    A  nonhomogeneous  functional  difference  can  be  written  uniquely  in  terms  of 
the  associated  homogeneous  difference: 

h  A  jf   =   j(h  A  /  +  c) 

(9) 

where  /:  S  -*  R  is  surjective,  and  h:  S  ->  S,  j  =  jR  _  R  +  q  and  c:  Q  —  R.    This  is  call  the  general 


form  of  the  solution  of  the  nonhomogeneous  equation. 
Proof:    Follows  from  the  preceding  proof.     □ 

3.    Examples  of  Differences 

In  this  section  we  give  several  examples  of  functional  differences.  We  begin  with  numerical  func- 
tions, since  they  are  most  familiar.  Let  IN  be  the  natural  numbers  and  let  a:  IN  ->  IN  be  the  suc- 
cessor function.  We  use  the  presection  and  postsection  notations  [Wile  '73]:  [a  +]  x  =  a  +  x, 
-  6]  x  =  x  -  6,  etc.    Also,  we  let  't1  represent  exponentiation,  a  ]  n    =    an. 

Definition  7:    We  write  '(powerffl  /)  n'  for  the  n(    power  of  function  /  applied  to  initial  value 
a:    (powera  f)  n    =    fn  a.    This  is  defined  recursively: 

(powera  /)  0    =    a 

(powera  /)  (n  +  1)    =    /  [(powera  /)  n],    for  n^O  (10) 

We  call  powera  /  'the  power  from  a  of  /'.  If  /:  S  ->  S  and  a  G  5,  then  it  is  clear  that 
powera  /:  IN  ->  S. 

Theorem  6:    The  difference  of  the  power  (from  a)  of  /  with  respect  to  successor  is  /, 

a  A  powertt  /    =    /, 

(11) 

provided  that  powera  /  is  surjective. 

Proof:   This  follows  directly  from  the  definition  of  'power': 

(powera  /)  (a  n)    =    f  [(powera  /)  n] 
Therefore,  (powera  /)   ■   a    =    /  •   (powera  /).    □ 

Theorem  7: 

<t  A  powera  /    =    fj  +  jc 
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(12) 

where  j  =  jR^s,  R  =  Im  (powera  /)  and  c:  (S  -  R)  ->  R. 

Proof:   Let  n:  R  -»  i?  be  powera  /  with  its  range  restricted  to  /?.    Thus, 

jtt    =    power a  / 

(13) 

Since  7r  is  surjective,  o~  A  7r  exists.    Observe  that 

Im  //'    =    Im  [/(powera/)]    =    Im  [(powera/)<r]    C    Im  (powera/)    =    R 

Therefore,  if  /'s  domain  is  restricted  to  R  then  its  image  is  a  subset  of  R.     Hence  there  is  a 

4>:  R  ->  R  such  that 

J4>    =    fj 

(14) 

The  definition  of  powera  /  is  equivalent  to: 

jna    =    (powera/)<r    =    /(powerfl/)    =    fjx    =    j<fin 

Hence,  jncr  =  j4>n.    Composing  a  left  inverse  of  j  with  both  sides  of  the  equation  yields 

■no    =    <pn 

(15) 

Since  n  is  surjective  a  A  n  =  <j>.    Then,  by  Cor.  5-1, 

a  A  powerfl  /    =  o  A  jn 

=  j{a  A  7T  +  c) 

=  j{4>  +  c) 

=  j4>  +  jc 

=    I  J  +  jc 


Now  observe  that 


Notice  that 
the  theorem 

o  A  [a  + 
o  A  [a  - 
a  A  [-  a 
<r  A  [a  x 
o-  A  fa  T 


powera  a 
powera  a 
power  .  a 
--    power0  [a  +] 
powerj  [a  x] 

the  last  two  of  these  are  not  surjective.    The  differences  of  these  functions  follow  from 


[a  +}j  +  jc    where   ;    =    ;Im  j.  y]^w 
[a  x]j  +  jc    where   j    =    jIm  (.  T]  ^  in 


4.    Properties  of  Differences 

We  develop  a  number  of  simple,  useful  properties  of  functional  differences. 

Theorem  8:    The  functional  difference  of  the  identity  I:  S  ->  S  with  respect  to  any  function 
h:  S  -►  5  is  that  function:    h  A  I    =    h. 

Proof:   Observe  that  g  =  h  satisfies  Ik  =  gl  and  that  I  is  surjective.    c 

Theorem  9:    A  functional  difference  of  h:  S  ->•  S  with  respect  to  itself  is  itself.    Further,  if  h 
is  surjective  then  h  A  h    =    h. 

Proof:   Observe  g  =  h  satisfies  hh  =  gh.    a 

Corollary  9-1:    A  difference  of  a  power  of  a  function  with  respect  to  that  function  is  that 


10- 


function.    Also,  if  hn  is  surjective  then  h  A  hn    =    h. 
Proof:   Let  g  =  h  in  hn  h  =  ghn.    □ 

Theorem  10:  A  (left)  inverse  of  a  difference  of  a  function  with  respect  to  a  surjection  is  a 
difference  of  the  function  with  respect  to  a  (right)  inverse  of  the  surjection.  That  is,  if  fh  =  gf 
then 

fKl  =  srlf 

(16) 

If  /  is  surjective,  then  (h  A  /)f  *    =    h~l  A  /. 

Proof:  Suppose  h  is  a  surjection  and  there  is  a  g  satisfying  fh  =  gf.  Suppose  that  g^1  is  a  left 
inverse  of  g.  Then  compose  g[l  with  both  sides  of  fh  =  gf.  This  yields  g[l fh  =  f.  Since  h  is 
surjective  it  has  a  right  inverse  h~  .  Composing  with  h~  on  both  sides  of  /  =  g[x fh  yields:  fh~l 
—  gf1  f.    Hence  gf1  is  a  functional  difference  of  /  with  respect  to  h~l.    □ 

It  will  usually  be  clear  to  drop  the  /  and  r  subscripts  and  write  (h  A  /)_1    =    h'1  A  /. 

Theorem  11:  A  difference  of  a  composition  of  two  functions  with  respect  to  a  third  is  a 
difference  of  the  first  function  with  respect  to  a  difference  of  the  second  with  respect  to  the  third. 
That  is,  if  <j>  is  a  difference  of  g  with  respect  to  h  and  xp  is  a  difference  of  /  with  respect  to  4>,  then 
xp  is  also  a  difference  of  fg  with  respect  to  h.  Also,  if  /  and  g  are  surjective, 
h  A  fg  =  {h  A  g)  A  f. 

Proof:   The  derivation  is  direct.    Suppose  gh  =  <pg  and  f<fi  =  ipf.    Then 

(fg)h   -   f(gh)   =  f{H)   -   (14>)g  =   {1>f)g   =   *{&). 

Hence,  (fg)h  =  ii>{fg).    If  /  and  g  are  surjective  then  the  differences  are  unique.    □ 

Corollary  11-1:  If  g  is  surjective  and  /  is  any  function  such  that  the  differences  exist,  then 
h  A  fg  =  {h  A  g)  A  f. 


Proof:     Suppose    that    /  =  ]<p,    with    0    surjective.     We    expand    the    general    form    for    the 
difference: 

h  A  fg  h  A  j<t>g 

=  j(h  A  <f>g  +  c) 

=  /[(A  A  g)  A  4>  +  c] 

=  (hAg)A  ]d> 

=  (hAg)Af 

The  third  line  above  follows  from  the  preceding  theorem.    □ 

Theorem  12:    The  difference  of  a  bijection  with  respect  to  a  composition  of  functions  is  the 
composition  of  the  differences  of  the  bijection  with  respect  to  each  of  the  functions: 

ghAf  =   (gA  f)(h  A  f) 

(17) 

Proof:   Since  /  is  bijective  it  has  the  two-sided  inverse  f~  ,  hence  by  Theorem  1: 
gkAf=    fghf1 

-  fg{rlf)hrx 

=  (fgr'Kfhr1) 

=    (gAf)(hAf) 


The  preceding  theorem  provides  a  kind  of  chain  rule  for  evaluating  differences  of  bijections.    In 
the  following  theorem  we  extend  it  to  any  functions  with  differences. 

Theorem  13:  A  functional  difference  of  a  function  with  respect  to  a  composition  of  functions 
is  the  composition  of  the  difference  of  the  first  function  with  respect  to  each  of  the  other  func- 
tions. That  is,  if  0  is  a  difference  of  /  with  respect  to  g  and  0  is  a  difference  of  /  with  respect  to 
A,  then  <t>xp  is  a  difference  of  /  with  respect  to  gh. 
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Proof:   Since  fg  =  <pf  and  fh  =  rpf  we  may  derive: 

f(gh)    -    (fg)h    =    (0f)h    =    <p(fh)    =    4>{rPf)    =    (4>v)f 
Hence  f(gh)  =  (4>rJ>)f,  and  <fiip  is  a  functional  difference  of  /  with  respect  to  gh.    a 

Corollary  13-1:  If  /  is  any  function,  gh  A  f  =  (g  A  f)(h  A  /),  provided  the  differences 
exist.  Note  that  if  /  is  not  surjective,  this  corollary  asserts  the  identity  of  the  general  forms  of 
the  differences. 

Proof:   If  the  differences  exist,  then  they  may  be  written 

g  A  /    =    j{g&4>  +  c),      h  A  /    =    j(hA<f>  +  c') 

where  j</>  =  f.    Now  observe  the  product: 

(g  A  f)(h  A  /)    =  j{gA4>  +  c)j{hAc/>  +  c') 

=  j(gA<f>)(hA<t>  +  c') 

=  ][{gA4>){h&<f>)  +{g±<t>)c'\ 

=  ;[(?A0)(/iA^)  +c"\ 

=  j(ghA<f>  +  c") 

The  last  line  follows  by  the  preceding  theorem;  it  is  the  general  form  of  gh  A  /.    □ 

Corollary  13-2:  A  difference  of  a  function  with  respect  to  the  nth  power  of  a  function  is  the 
nth  power  of  a  difference:    hn  A  /    =    (h  A  /)". 

Proof:   This  is  an  inductive  application  of  the  previous  theorems.    □ 
We  use  a  product  notation  for  compositions: 

]1  F{  =  F,  .  F2 F._,  ■  Fn 

Using  this  notation  we  can  express 
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Corollary  13-3:    A  difference  of  a  function  with  respect  to  a  product  of  functions  is  the  pro- 
duct of  differences  with  respect  to  each  of  those  functions: 


<n  w  a  /  -  n  <*.  a  /)  (18) 


Proof:   An  inductive  application  of  the  theorems.    □ 

Corollary  13-4:  If  xn  =  hnx0,  then  fxn  =  (h  A  /)"  (/z0),  where  h  A  /  is  any  difference  of  / 
with  respect  to  h.    That  is,  if  y,  =  fxt  then  yn  =  (h  A  f)ny0.    Equivalently,  y  =  poweryo  hAf. 

Proof:   This  is  an  induction  based  on  yn    =    f  {hxn_x)    =    (h  A  /)  {fxn_l)    =    (h  A  /)  yn_v    3 

CoroUary  13-5:    If  xn    =     Ml  //,  U0  and  J/.    =    ^,  then  ^    =      IT  ^,  A  F  y( 
Proof:  This  is  just  an  application  of  Cor.  13-3.    □ 

This  theorem  tells  us  how  to  use  functional  differences  to  get  from  fx0  to  fxn,  provided  xn  is 
reachable  from  i0.    It  is  a  functional  difference  analogue  of  Taylor's  Theorem. 

We  define4  lA/'  so  that  (A/)  h  =  h  A  /.  Since  A/  leaves  h  unspecified,  we  call  it  the 
indefinite  functional  difference  of  /.  One  difficulty  with  this  notation  is  that  (A/)/i  is  defined 
only  if  E,  C  E^  (Theorem  3),  and  is  single  valued  only  if  /  is  surjective  (Theorem  4).  To  avoid 
these  problems  we  restrict  the  notation  A/  to  the  case  in  which  /  is  bijective,  since  then  we  are 
guaranteed  that  the  indefinite  difference  exists  (Theorems  2  and  4). 

Definition  8:    The  indefinite  functional  difference  A/:  (S  -»  S)  ->  (T  ->•  T)  is  defined: 

(A/)A    =    h  A/ 

(19) 

for  any  bijection  /:  S  <-*  T.    Note  that  the  signature  of  A  is: 


4.    This  is  simply  the  postsection  notation  from    Wile  '73  . 
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A:  Bijec  (S,  T)   -  \(S  -  S)  -  (T  -  T)j 


(20) 


where  Bijec  (5,  71)  is  the  category  of  all  bijections  from  5  to  T, 

Theorem  14:    The  indefinite  difference  of  the  composition  of  bijections  is  the  composition  of 
the  indefinite  differences  of  the  bijections: 

A  (/  •  g)    -    (A/)  •   (Ag) 

Proof:    By  Theorem  11: 

(Afg)h    =  hAfg 

=  (hAg)Af 

=  (Af)(hAg) 

=  A/[(Aj)A] 

Hence,  A  fg  =  A/  °  A^.    n 

The  preceding  theorem  is  a  kind  of  chain  rule  for  functional  differences.    It  leads  to 

Corollary  14-1:    The  indefinite  difference  of  the  nth  power  of  a  bijection  is  the  nth  power  of 
the  indefinite  difference  of  that  bijection:    A  /"    =    (A/)n. 

Proof:   This  is  just  the  inductive  extension  of  the  previous  theorem.    □ 

Corollary  14-2:    The  indefinite  difference  of  the  product  of  bijections  is  the  product  of  the 
indefinite  differences  of  those  bijections: 


n/, 


IIA/, 

»=i 


n 

/  ■     \ 

That  is,  h  A 

n/, 

1=1 

-a** 

(M 


Proof:   This  also  follows  inductively  from  the  theorem.     □ 
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5.    Recursive  Programs 

Let  T*  be  the  type  of  all  LISP-like  lists  whose  members  are  of  type  T.    Consider  the  following 
equations,  which  define  the  function  length:  T*  -»  IN  on  lists: 

length  nil    =    0 

length  (z  :  y)    =    1  +  length  y  (21) 

(Here  lx  :  t/'  denotes  the  result  of  prefixing  x  on  the  list  y  ~  the  LISP  'cons'  operation.)  The 
second  equation  is  a  homogeneous  functional  difference  equation,  as  can  be  seen  by  writing  it  in 
the  form: 

length  •   [x  :]    =    a  «   length 

(22) 

(Note  that  [x  :]:  T*  -»  T* .)  Hence  it  is  easy  to  see  that  the  change  in  length  with  respect  to 
prefixing  is  the  successor: 

[x  :]  A  length    =    a 

(23) 

On  the  other  hand,  if  we  were  to  define  length  recursively,  we  would  write  something  like  this: 

0,  if  L  =  nil 

length  L    =   |x  +  length  ^est  L^      .f  L  ^  nU  (24) 

This  corresponds  to  the  equations 

length  nil    =    0 

length  L    =    1  -  length  (rest  L),  for  L  ^  nil  (25) 

The  second  equation  here  is  also  a  sort  of  difference  equation,  but  it  does  not  fit  our  earlier  form. 
Written  in  terms  of  compositions  it  is: 

length  °   j \     =    a  '   length  =   rest 

(26) 

where  we  have  composed   length  with  j+   to  restrict  its  domain   to  nonnull  lists.    The  function 
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y+  =  JT  r»  injects  the  type  of  nonnull  sequences  T+  into  the  type  of  (possibly  null)  sequences 
T*.  Note  also  that  we  assume  'rest'  is  a  total  function,  rest:  T+  -*  T* .  Hence  the  domains  and 
ranges  of  the  functions  match  as  required  by  the  compositions. 

What  is  the  relationship  between  the  two  difference  equations  satisfied  by  length?  Consider 
the  first  difference  equation  (22): 

length  °    [x  :]    =    a  °   length 

(22) 

We  would  like  to  compose  with  the  inverse  of  [x  :]  on  both  sides.  Unfortunately  we  can't  do  this 
because  [x  :]  is  not  a  surjection,  so  it's  not  right  invertible.  Therefore  we  will  have  to  use  an 
alternate  approach. 

Let  xT*  C  T+  represent  the  type  of  all  sequences  that  begin  with  x.  Since  the  meaning  of 
[x  :]  is  to  put  x  on  the  front  of  its  argument,  we  will  consider  the  bijection  Kx:  T*  -»  xT*\  this 
operation  is  [x  :j  with  its  range  restricted  to  xT*.  Hence  [x  :]  =  j+jzxz,  where  jz  =  JzT*^T  •  Since 
7r z  is  a  bijection,  it  inverse  jrj1:  xT*  -»  T*  exists  (and  is  a  bijection).  The  meaning  of  nz1  is  to 
take  x  off  the  front  of  a  sequence  that  begins  with  x.  On  the  other  hand  'rest'  takes  the  first 
thing  off  the  front  of  its  argument  no  matter  what  it  is.  Hence  tt~x  is  like  'rest'  except  that  it's 
defined  only  on  lists  whose  first  element  is  x.  That  is,  n'1  is  a  restriction  of  'rest'  to  the  domain 
xT*,  n~ 1  =  rest  °   jz. 

Now  we  make  two  simple  observations.  First,  the  type  of  all  nonnull  lists  is  the  direct  sum, 
for  all  x,  of  the  nonnull  lists  that  begin  with  x: 

T+    =    £  xT* 

xeT 

Second,  the  'rest'  function,  which  deletes  the  first  element  of  a  list  no  matter  what  it  is,  is  the 
direct  sum  of  all  the  functions  jrj1,  which  delete  x  from  the  front  of  a  list: 

rest    =    rest  •    J]  jz    =     J]  rest  •  jx    =     £  ir'1 

ztT  z€T  ziT 
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It  is  now  easy  to  show  the  two  difference  equations  are  equivalent. 
Theorem  15:    Suppose  that 

length  '   \x  :]    =    a  •   length 

is  true  for  all  x.    Then 

length  •  j+    =    a  °   length  °   rest 

The  converse  also  holds. 

Proof:   To  prove  the  first  (Eq.  27)  implies  the  second  (Eq.  28)  we  have: 

o  °   length    =    length  °    \x  :] 

=    length  •   j+  •   jz  '   7Tt 

Compose  on  both  sides  with  7T"1  to  yield: 

o  '   length  •   k'1    =    length  °  ;+   °   jz 

Now  derive: 


length  •   ;'+    -    length  •   j+  •    J]  ;2 

i6  T 

X)  (length  •  ;+  °  ;a 

z6T 


J]  (<r  ■   length  ■   tt'2 


ci  r 


(27) 


(28) 


<r  °  length  °    Yj  nzX 

re  r 

<r  »  length  °  rest 


This  is  Eq.  28. 

To  prove  the  second  (Eq.  28)  implies  the  first  (Eq.  27)  we  restrict  both  sides  to  xT*: 

length  °  j.   •  j     =    a  °  length  °   rest  ■  j 


Recalling  that  rest  °  jz    =    tt~x: 

length  °  y+  •  jj    =    «r  ■   length  ■   7T"1 
Now  compose  with  irz  on  both  sides  to  obtain  Eq.  27.    □ 

6.    Definition  and  Existence  of  Integral 

In  this  section  we  consider  a  functional  integration  operation  that  is  inverse  to  the  functional 
difference.  That  is,  given  functions  g:  T  ->  T  and  h:  S  -*  S  we  want  to  find  an  /:  S  ->  T  that 
satisfies  the  functional  difference  equation  /A  =  9/. 

In  general  there  may  be  many  functions  satisfying  this  relationship.  Since  this  implies  that 
the  solution  to  a  functional  difference  equation  is  often  under  determined  by  the  equation,  to 
determine  a  particular  solution  it's  necessary  to  specify  a  boundary  function  b  contained  in  the 
solution.  Thus  the  solution  to  the  equation  is  required  to  be  an  extension  of  the  boundary  func- 
tion (i.e.,  b  =  }jD^s,  where  D  C  S). 

Definition  9:  Suppose  DCS.  Let  arbitrary  functions  g:  T  -*  T,  h:  S  -»  S  and  6:  D  ->  T  be 
given.    If  there  is  a  function  /:  S  -»  T,  with  6  =  fjD^s,  satisfying  the  equation 

f  •  h    =    g  •  f 

then  we  call  /  the  definite  functional  integral  with  respect  to  h,  from  b,  of  g.    We  write  /: 

h  $„  9 

This  is  read  "the  h  integral  from  b  of  g." 

Theorem  16:    If  the  definite  functional  integral  exists,  then  it  satisfies  the  equation: 

[h  $;,  g)    '   h    =    g  •    (A  $6  0) 
Proof:   Follows  immediately  from  definition.    □ 
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Next  we  explore  some  of  the  conditions  under  which  functional  integrals  exist. 
Definition  10:    5  is  generated  from  D  by  h:  S   -  S  if  and  only  if 

S   =    J  h*[D\ 

n?0 


(29) 


(The  notation  hn[D]  denotes  the  image  of  D  under  hn.)    This  is  equivalent  to  5  satisfying  the 
recursive  equation 

S   =   D  u  h[S] 

(30) 

Note  that  if  5  is  generated  by  h,  then  h  is  surjective. 

If  the  generation  of  S  loses  information  that  is  required  by  g,  then  the  functional  integral  can- 
not be  computed;  this  is  formalized  in  the  following  theorems.  To  state  them  we  introduce  the 
class  of  functions  for  which  functional  integrals  will  be  shown  to  exist: 

Definition  11:  Suppose  g:  T  -*  T,  b:  D  -»  T,  and  S  is  generated  from  D  by  h:  S  —  S.  We 
say  that  the  functions  g  b  ignore  the  generation  of  S  if  and  only  if,  for  all  x0,  x0'  G  D,  m,  n  ^  0, 

(31) 

That  is,  the  functions  gkb  don't  care  if  an  element  of  S  can  be  generated  in  two  or  more  ways. 

Lemma  17-1:  Suppose  6:  D  ->  T,  f:  S  ->■  T,  g:  T  -»  T,  b  -  fjp^s^  anc*  S  is  generated  from 
D  by  h.    If  fh  =  #/  has  a  solution  then  the  functions  gkb  ignore  the  generation  of  S. 

Proof:  Let  x  €  S  and  j  =  jD^s.  Suppose  hmjxQ  =  x  =  hnjx0'  for  z0,  x0'  €  D.  (Note  that  for 
z0  €  D,  jx0  =  xQ.)    By  Cor.  13-4, 

fx    =    fhmjx0    =    gmfjx0    -    gmbx0 
fx    =    fhnjx0'    =    gnfjxQ'    =    gnbx0' 

Hence,  gmbx0  =  gnbx0'.    a 
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Next  we  give  a  formula  for  the  h  integral  from  b  of  g.    It  is  defined  in  terms  of  the  graph  of 
the  function. 

Definition  12:    If  b:  D  -  T,  h:  S  -+  S,  g:  T  -  T,  and  DCS,  define  the  relation  &hbg  as  fol- 
lows: 

*kbg    =    {  (A"*o,  9n^0)  |   x0  e  £>,  n  >  0  } 

(32) 

Lemma  17-2:  If  the  g  b  ignore  the  generation  of  S,  then  there  is  a  unique  function  4>kb  such 
that 

graph  </>hbg    =    <f>kbg 

(33) 

where  graph  /  is  the  graph  of  the  function  /  (i.e.,  the  set  of  (x,  y)  such  that  fx  =  y.).  Further, 
this  function  satisfies 

^W^o)    =    9nbx0     for  x0  e  D 

(34) 

Proof:  Clearly  there  is  at  most  one  function  4>:  S  ->  T  having  a  given  graph.  Thus  it  is  necessary 
to  show  that  <$>  =  <phb  is  defined  and  single  valued  for  every  member  of  S.  Since  S  is  generated  by 
h  from  D,  each  x  G  S  can  be  written  x  =  hnx0  for  some  xQ  £  D,  n  ^  0.  Hence,  from  the  definition 
of  <l>^    we  see  4>x  is  defined  and 

<px    =    gnbx0,   for  x  =  hnx0 

(35) 

To  show  <j>x  is  single  valued,  assume  hmx0  =  hnx0' .    By  Eq.  35, 

<t>x    =    gmbx0,     4>x    =    gnbxQ' 

But  the  gkb  ignore  the  generation  of  5,  so  gmbxQ  =  gnbxQ' .    Hence,  </>  is  single  valued.    □ 

Next  we  prove  that  4>hb    is  a  solution  provided  the  g  b  ignore  generation. 
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Lemma  17-3:    If  the  gkb  ignore  the  generation  of  5,  then 

<t>hbg     =     9<t>hbg 


(36) 


Proof:    For  an  arbitrary  x  G  S  we  show  <phx  =  g<frx,  where  <f>  =  <f>hbg.    Since  5  is  generated  from  D 
by  /*,  write  x  =  hnjx0,  where  j  =  jjj^s-    Then, 

4>hx    =    <f>hn*1jxQ,   since  x  =  hnjx0 
=    gn  +  1bx0,    by  Lemma  16-2 

=  ggnbz0 

=    g<frx,    by  Eq.  35 


We  can  now  prove  our  principal  existence  theorem: 

Theorem  17:    Let  h:  S  ->  S,  b:  D  ->  T,  g.  T  ->  T,  and  suppose  S  is  generated  from  D  by  h. 
Then  fh  =  gf  has  a  solution  if  and  only  if  the  gkb  ignore  the  generation  of  5. 

Proof:   This  follows  from  Lemmas  17-1  and  17-3.    □ 

Our  next  goal  is  to  show  that  4>hb    is  the  unique  solution  of  the  difference  equation. 

Lemma  18-1:    Suppose  h:  S  -  S,  b:  D  ->  T,  g:  T  -»  T,  and  /:  S  -*  T.    If  the  gkb  ignore  the 
generation  of  5  and  /  is  a  solution  to  fh  =  gf,  then  /  =  0A6ff. 

Proof:   Suppose  x  =  hnx0  for  xQ  G  -D.    By  Cor.  13-4, 

fx    =    fhnjx0    =    gnfjx0    =    gnbxQ    =    cf>hbgx 


Theorem  18:    Suppose  h:  S  -*  5,  b:  D  -»  T,  5:  T  -»  T.    If  5  is  generated  from  Z?  by  A,  but 
the  g  b  ignore  this  generation,  then 
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*  *.  f  -  *„,  (37) 

Proof:    This  follows  from  Lemmas  17-3  and  18-1.    □ 

7.    Properties  of  Integrals 

The  following  corollaries  follow  easily  from  the  preceding  theorems  and  from  the  properties  of 
differences  in  section  4. 

Corollary  18-1: 

[h$bg\   {hnx0)    =    gnbx0,   torxQeD 

(38) 

Proof:   Follows  from  Theorem  18  and  Lemma  17-2.    □ 

Corollary  18-2:    h  <J>Ifl  h    =   I. 

Proof:   Follows  from  Thm.  8.    □ 

Corollary  18-3:    h  <&hjD     h    =    h. 
Proof:   Follows  from  Thm.  9.    □ 

CoroDary  18-4:    h  <J>A„         h    =    hn . 
Proof:   Follows  from  Cor.  9-1.    □ 

Corollary  18-5:  Suppose  h:  R  -  /?,  </>:  S  -  S,  0:  T  -*  T,  b:  S0  -»  T,  c:  RQ  -  5,  where 
S0  C  S  and  i?0  C  R.  Then,  if  the  xpkb  ignore  the  generation  of  S  by  0,  and  the  <f>kc  ignore  the 
generation  of  R  by  h,  and  the  t/'  be  ignore  the  generation  of  R  by  h,  then 
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(0  <!>„   V)(h    $c   0)     =     h   $6;f   0 

(39) 
where  ;  =  ;5^5 

Proof:    Follows  from  Thm.  13.    □ 

The  following  two  theorems  are  the  Fundamental  Theorems  relating  fixed  differences  and 
integrals. 

Theorem  19:    Suppose  /:  5  -»  T,  h:  S  -»  S  and  b  =  fjjy^s,  where  S  is  generated  from  D  by 
h.    If  Et  C  £■„  and  /  is  surjective, 

**t{*Afl-/  (4Q) 

Proof:  Under  the  stated  conditions  the  difference  equation  /fc  =  gf  has  a  unique  solution 
g  =  h  A  f.  To  show  that  /  is  the  functional  integral  of  g  with  respect  to  h  we  must  show  that 
the  gkb  ignore  the  generation  of  S  by  h.  Therefore  suppose  hmjx0  =  hnjx0\  where  j  =  jp^,s. 
Then, 

gmbxQ    =    gmfjx0,   by  definition  of  6 

-  fhmjx0,   Cor.  13-4 

=    fhnjx0',    by  hypothesis 

-  gnfjxQ\   Cor.  13-4 

=    gnbxQ,    by  definition  of  b 

Hence  /  is  the  h  integral  from  b  of  g:  h  (|)6  g  =  f.  Combining  with  g  =  h  A  /  yields  the  desired 
result.    □ 

Theorem   20:    Suppose  h:  S  ->  S,   b:  D  -*  T,  g:  T  -»  7\  and  S  is  generated  from  Z)  by  /i. 
Then, 


-24- 


hA\h$bg\     =    g  (4i) 


if  and  only  if  T  is  generated  from  b[D]  by  g. 

Proof:  Under  the  stated  conditions  the  integral  /  =  h  <J> b  g  exists.  The  difference  will  exist 
and  be  unique  if  /  is  surjective  and  Ej  C  E  ^.  To  determine  the  conditions  under  which  /  is  sur- 
jective  we  compute  a  formula  for  the  image  of  /: 

Im  /    =  rng  *Wff 

=  rng{  {knx0,  gnbx0)  \   x0eD,n>0} 

=  {  gnbx0\   x0  e  D,  n  ^  0  } 

=  |J   Im  gnb 

Now  observe  that  T  =   (J  Im  gnb  if  and  only  if  T  is  generated  from  b[D]  by  g. 

Next  we  must  show  E,  C  E^.  Therefore  assume  fx  =  fx' ;  that  is,  fhmx0  =  fhnxQ'.  By  Lem. 
17-2,  fhmx0  =  gmbx0  and  fhnx0'  =  gnbx0'.    Hence,  gmbx0  =  gnbxQ  .    Now  derive: 

fhx    =  fhm-lx0    =    gm  +  1bx0 

=  g(gmbx0)    =    g(gnbxQ') 

=  g*  +  Hx0'    =    fhn  +  lx0' 

=  fhx' 

Hence  E,  C  E*  and  the  difference  is  unique,    n 

The  following  corollary  shows  that  the  difference  of  a  nonsurjective  integral  is  the  integrand  plus 
a  remainder  term. 


Corollary  20-1:    If  T  is  not  generated  from  b[D]  by  <?,  then 
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h  A  \h  $„  g)    =    gj  +  jc 


where  h:  S  -»  5,  6:  D  -  T,  $:  T  ->  T,  j  =  ;^r,  c:  ( T  -  #)  -»  K,  and  fl  =  Im  (;  $6  9). 

Proo/:  Let  Q  =  T  -  R.  Since  /2  =  Im  (A  $6  y)  we  can  write  g  =  jq  +  r  where  q:  R  ^  R 
and  r:  Q  ^  T.  Note  that  ?  is  surjective  and  /?  is  generated  from  6  Z)]  by  9.  Hence  h  <$> a  q 
exists,  where  a:  D  ^  R,  ja  =  b.    Note  that  A  $&  9  =  ;'(A  <|>a  9)  and  apply  Cor.  5-1: 

hA(h$bg)    =    hAj(h  $a  q) 

=    ;[/>  A  (A  $fl  9)  +  c] 

=  j{q  +  c) 

since  h  $a  9  is  surjective.    Now  observe  that 

9  j  =  (Jq  +  r>i  =  ;? 

Hence  the  difference  of  the  integral  is  gj  +  jc.    □ 

The  functional  integral  permits  a  different  characterization  of  the  power  functional: 
Theorem  21:    The  a  integral  from  0  -*■  a  of  /  is  the  power  from  a  of  /: 

»  $0   a  /    =    powera  / 

(43) 

Proof:    Note  that  IN  is  generated  from  {0}  by  (T;  to  show  the  existence  of  the  integral  we  must 
show  that  the  /     ■   (0  -»  a)  ignore  this  generation.    Hence  we  need 

<rm0  =  <rn0    =s»    /w(0  -  a)0    =    /"(O  -  a)0 

The  left-hand  side  of  this  implication  is  equivalent  to  m  =  n,  which  obviously  implies  the  right- 
hand  side.    Therefore,  the  functional  integral  exists  and  satisfies  the  following  equation: 


(*$0^/J*     -     /("$0-«/ 
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(44) 


But  this  is  just  the  difference  equation  which  defines  the  power  function.    □ 

The  following  corollary  is  Thm.  7,  but  obtained  via  the  integral. 
Corollary  21-1: 

a  A  powera  f   =    fj  +  jc 

where  j  =  jR^s  and  R  =  Im  (powera  /). 
Proof:   By  the  theorem: 

a  A  powera  /    =    o  A  (a  $0-o  /)    =    fj  +  3C 


(45) 
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